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ABSTRACT 


Ihe objectives of this study were twofold: to identify 
those cognitive skills required by the shipboard officer of 
the deck (OOD), and to determine if these skills are 
affected by simulated ship motion. The Position Analysis 
Questionnaire (PAQ) was used to analyze the duties of the 
OOD, and the important areas so identified were tested using 
the Automated Portable Test System (APTS) and a ship motion 
simulator. Analysis of the results revealed statistically 
significant effects on OOD performance due to motion in the 
areas of visual search and reasoning. In addition, there is 
some graphical indication that either higher or lower error 
rates are associated with motion, depending on the nature of 
the task. 


10 


11 
1 
12 
12 
I3 


15 
15 
16 
17 
17 


ILS, 
19 
20 
20 


23 
23 
23 
23 
23 
22 
26 


29 
49 


TABLE OF CONTENIS 


INERODUCTION 
A. BACKGROUND . 
ظط‎ NM OB 6 ٣ 


STRESS AND MOTION 


A. STRESS . 
B: MOTION . 
je Vibration 


2. ۷۸۲۶۰۰71۷6 1 


POSITION ANALYSIS QUESTIONNAIRE 
A. BACKGROUND . 

B METHOD . 

OS RESULTS 

D DISCUSSION. 


AUTOMATED PORTABLE TEST SYSTEM . 
A. | BACKGROUND . 


ES KRELĀTJION OF APTS WITH PAQ . 


Comme: > CRIPTION OE TESTS . 


EXPERIMENTAL METHOD 
AUR EOS! ۸۲۱۱7056 5 
PRHE T EXPERIMENT 


ime Participants 二 
2. Experimental Apparatus . 
3. Experimental Design 


Cee ANALISIS PROCEDURES . 


RESULTS 
A. PATTERN COMPARISON TEST 


DI. 


IV. 


ME 


52 
SIA 
32 
32 
393 


42 


45 


50 


52 


55 


56 


60۳3٦725۲ ۲ 0 TEST =. 
REASONING TEST . 

۶۳ ۶ئ ٣۲۳۶۲۱6‏ تک 

۹ TES 
CORRELATION ANALYSIS . 


DE 


V CONCLUSIONS 


SELECTED  +) 04 ani POSTA‏ ء۰ ط7۰٣‏ ۴70 ۶ ہم 
ANALYSIS QUESTIONNAIRE . .‏ 


APPENDIX B: RAW DATA SCORES 
LISIZOFEREFERENGES 
BIBLIOGRAPHY 


INT IAESPTSTRIBUTION ER ۷۳ 


Li 
AL 
26 
27 
28 


S 


EM 


34 
34 


Se 
26 


38 
28 


41 
41 


41 


LIST OF TABLES 


PAQ RESULTS 

MATCHED PAQ QUESTIONS AND APTS TESTS 
EXPERIMENTAL DESIGN 

ANOVA- MOTION AND ORDER EFFECTS 
ANOVA- LEARNING EFFECTS 


PATTERN COMPARISON MOTION AND ORDER 
EFFECTS (EX B AND EX C) 


GROUPS) ^. M c ۳۶ E E ee 


GROUP ۔‎ 
CODE SUBSTITUTION MOTION AND ORDER EFFECTS (EX 
ED EX O AL l.c uv... مس‎ 


CODE SUBSTITUTION LEARNING EFFEC. (ALL GROUPS) 
2888ء‎ MOTION AND ORDER EFFECTS (EX B AND 
REASONING LEARNING EFFECT (ALL GROUPS) 
STERNBERG MOTION AND ORDER EFFECTS (EX B AND 
STERNBERG LEARNING EFFECT (ALL GROUPS) 

LANDOLT C MOTION AND ORDER EFFECTS (EX B AND 
LANDOLT C LEARNING EFFECT (ALL GROUPS) 


Km 떠 BETWEEN APTS TESTS AND BACKGROUND 


Om BP WC N PB 


POE 


Er 
12) 


lox 
14. 


EST 
16. 


25 
30 
33 
35 
34 
40 


LIST OF ۶۱۷۱۷۳ ط0‎ 5 


Silt) Mot 7 111 MU ESE 


Pattern Comparison Test Results - 


Code Substitution Test Results 
Reasoning Test Results 
Sternberg Test Results 

Landolt Test Results 


Mm wb O DH 


a a a da da ما‎ 


77 0 ۷ 


A. BACKGROUND 

Ihe underway officer of the deck (OOD) onboard a naval 
vessel holds complete responsibility under the commanding 
emereer for virtually everything happening both on and to 
the ship during his watch. This responsibility entails a 
large number of diverse tasks, calling on many different 
skill areas. These tasks must be performed concurrently, and 
often under less than ideal working conditions. Frequently, 
the OOD is subject to such potential causes of stress as 
extremes of temperature, ship motion due to inclement 
weather, and fatigue due to loss of sleep, overwork, or 
eontlietszwith his normal diurnal rhythm.: 

In a study of mishaps at sea in the Coast Guard (System 
Development Corporation, 1984a), it was determined that the 
greatest single primary cause of mishaps was human error. 
In another study (System Development Corporation, 1984b) the 
author investigated the causes of this phenomenon. Risk 
mMmazardous working conditions), intensity of operational 
tempo, boredom and monotony, sleep disturbance, and rough 
seas all contributed to preventing the crew from performing 
at their peak. The author warns that human error is more 
commonly a factor in mishaps than accident reports indicate, 
as those involved often believe that admitting to fatigue or 
stress 1s a sign of weakness. 

Ei focuses on ship motion, one of the factors 
which can contribute to crew performance decrement. The 
purpose is not to investigate the long term effects of 
constant motion in a vigilance situation, but to determine 
if the presence of motion presents a short term hindrance 


to the cognitive abilities needed by an OOD. 


OBJECTIVES 

Ihis study has the following primary objectives: 
Ascertain what cognitive skills are needed by the 
1111667۷3۰7۳ ٣٦٦ب‎ ى٣‎ (Elie sce cic | 

lest qualified  OODs under conditions of non-motion and 
simulated ship motion to determine if these skills are 
affected by motion. 

If such an effect is found for any of the skills, inves- 
tigate further to determine if the effect is positive or 
negative. 

Additional secondary objectives for the study include: 
Explore the relationships between overall performance on 
the appropriate cognitive tests and certain items of 
background data, including level of experience and 
performance on one traditional intelligence test. 
Evaluate the computerized test system used for this 
study to determine how well it fulfills the requirements 


of testing ror chlespurpose, 


10 


(1) 


(2) 


(3) 


(4) 


(>) 


Il: SESS AND MOTION 


ie 6 
As yet, no precise scientific definition of stress has 

been fully agreed upon. In one good definition, Selye (1979) 

defines stress as "The non-specific response of the body to 

any demand." He divides this response into three phases: 

(1) Alarm reaction, occurring at the onset of the stressful 
condition. This phase includes both the shock reaction, 
and the  countershock reaction, in which the organism 
begins to muster its defensive capabilities to combat 
the stress. 

(2) Resistance stage, which is characterized by full adapta- 
tion to the stressful condition, although the resistance 
to other stimuli is decreased. 

(3) Exnaustion, which occurs when the individual's capacity 


to adapt is eventually surpassed. 


The effects of stress on performance are not the same 
for all stressors. Hockey (1979, p. 142) defines a stressful 
condition as one which increases arousal. He notes that 
sleep loss does not fit this definition, as it has the 
tendency to decrease arousal, and indeed the effects of 
sleep deprivation are often quite different from those of 
other forms of stress. Broadbent (1971, p. 408) notes that 
the effects of noise and sleep loss are actually antagon- 
istic to each other under some circumstances. 

Mild stress, which increases arousal, may have the 
effect of improving performance. The  Yerkes-Dodson law 
(Hockey, 1979, p. 143) states that for every task there 
exists a level of arousal such that performance is optimized 
at that level, and tends to decline with either more or less 


arousal. Additionally, the law states that the more 
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difficult the task, the lower the level of arousal optimal 
for that task. 

As stress-induced arousal increases past the optimal 
level, the deterioration of performance that takes place is 
not general, but is more specific (Hockey, 1979, p. 163). 
The subject tends to increase the selectivity of both atten- 
tion and response, focusing on those areas with the highest 


probability of containing useful information and ignoring 


all others. 

Broadbent (1971, p. 402) discusses the effects of noise, 
high temperature, and sleep loss on tests of continuous 
serial reaction. These types of tests are time limited, 


presenting a new stimulus as soon as the current one has 
been correctly responded to. The effect normally noted is 
not slower reaction time, but is an increase in the error 
rate. However, the timing and degree of the effect differs 
for the different stressors, indicating the possibility of a 


different mechanism for each. 


BN MOTTON 
Motion is an ever-present shipboard form of  environ- 
mental stress that could have a negative impact on the 
performance of the OOD. There are two distinct types of 
motion mentioned in the literature: vibration, and very low 
frequency (VLF) vibration, more commonly thought of as 
"motion". Although vibratory movement is not evaluated as a 
part of this study, a brief summary of its effects is 
provided, since the bulk of movement-related research has 
been related to vibration, and the many common factors 
between the two types of motion make the information 
worthwhile. 
ll. Vibration 
Vibration is generally defined to be repeated move- 
ment at a frequency greater than 1 Hz, while motion (VLE 
vibration) is defined as movement at a rate slower than 1 


Hz. (Human Factors Engineering Branch, 1977, p. 1) 
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Shoenberger (1974), and Lewis and Griffin (1976) 
found effects on cognitive performance in studies of vibra- 
tion. The authors believe that most of the detrimental 
effect can be attributed to the mechanical aspects of 
motion. Shoenberger's task involved the use of visionina 
memory-reaction time task. He found that visual blurring 
caused the subjects' performance to decline, but found no 
evidence of vibration interfering with the subjects' central 
processing capabilities. Lewis and Griffin studied a manual 
tracking exercise, and, similarly, found that the subjects' 
performance degradation was primarily due to the vibration 
interfering with the normal kinesthetic feedback mechanisms 
used to control arm motion. 

Some types of vibrational movement are more perform- 
ance degrading than are others. Sjof Fot and Suggs (1973) 
found that vertical vibrations degrade performance far less 
than either transverse (side to side), or longitudinal 
(front to back) vibrations. Allen (1971) found that the 
interaction between the effects of different vibrational 
directions is considerable. 

2 VLE Vibration 

There has been less investigation into VLF vibration 
than there has been with higher frequency vibrations. 
Studies of the kind of motion associated with a ship have 
been especially limited in number and scope because of the 
mene 76 in building a realistic simulator. The 
large (10-20-foot) rise and fall associated with a ship in 
heavy seas can only be adequately simulated by an apparatus 
with a similar range of motion (Yonekawa, ET The 
Aerospace Medical Research Laboratory Vertical Accelerator 
is such å simulator (Shoenberger, 1975), but its use has 
largely been limited to the study of motion sickness, and in 
producing scales of discomfort to be used in occupational 


safety and health guidelines. 
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From the limited studies done to date, the differ- 
ence between effects due solely to the motion itself, and 


those due to motion sickness appears to be surprisingly 


clear cut. A Coast Guard study (U.S. Department of 
Transportation, 1980) found that performance appeared to 
decline at the advent of motion sickness, but not before. 


Similarly, the Human Factors Engineering Branch at Pt. Mugu 
Naval Missile Center (1975, p. 5) failed to find a gradual 
performance decrement associated with motion, but instead 
found an abrupt decline coinciding with the onset of phys- 


ical symptoms (vomiting). 
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III. POSITION ANALYSIS QUESTIONNAIRE 


A. | BACKGROUND 

In order to identify the skill areas of greatest impor- 
tance to the OOD an analysis of the duties performed on the 
watch is necessary. Fortunately, a questionnaire designed 
for this task is already available. 

The Position Analysis Questionnaire (PAQ) is a tool used 
by industry as well as the Navy to assess the types of 
skills required by a job. The test version used for this 
study is from Harris and McCormick (no date). Key questions 
are reproduced in Appendix A. The questionnaire consists of 
186 job attributes. For each of these the respondent 
assesses the importance of that attribute to his job, or its 
frequency of use, or some other similar grading, on a scale 
of 1 (low) to 5 (high). The PAO has been shown to be a good 
predictor of such things as job status and pay, and as a way 
of accurately comparing different positions for underlying 
similarities (CNO, no date). 

McCormick and others (1972, p. 349) describe the major 
areas investigated by the PAQ. These are: 

MI tormaerón input. 

(2) Mediation processes (information manipulation and use). 
(3) Work output (manual activities). 

(4) Interpersonal activities. 

(5) Work station (environmental attributes). 


(6) Miscellaneous (job demands and level of responsibility). 


Horepmrooses Of this study, the first two groups of 
questions are of most interest, as these correspond with 
generally measureable mental aptitudes. 

According to PAQ Services, Inc. (1983) the questionnaire 


is intended for use as a placement tool, rather than as a 


Do 


screening tool. In other words, it is designed to the 
strengths of an individual with the best possible job for 
him. An established data base for the candidate positions is 
considered a good predictor of job holder is The 
gravitational hypothesis of McCormick and others (1972, p. 
52) postulates that individuals tend to be attracted to and 
to stay with jobs they are good at, and to leave those that 
they are not good at. This argues for minimizing 5:8 671 
by matching the job to the person initially. Additionally, 
it is hypothesized that the PAQ is a good predictor because 
even basic skills thought to reflect innate ability may be 
honed nn ۴ ۹٣ ۴(٣ ۱ 

One study which confirmed the value of the PAO in 
defining work attributes was conducted by Shannon (NBL, 
1982). In this study, the PAQ was used to predict skills for 
Navy E-2 combat information control officers and operations 
specialists. The PAQ results were supplemented by interviews 
and observations of the work environment. The high correla- 
tion between the different respondents' answers indicated 
that the PAQ presents a good picture of the jobs. 

Carter and Biersner (NBL, 1982) attempted to correlate 
PAQ scores with tests in the Armed Services Vocational 
Aptitude Battery (ASVAB). They succeeded in showing a corre- 
lation between skills required and skills posessed by the 
respondents. Overall, the PAQ appears to be ideally suited 


to assess OOD skill areas for this study. 


B. METHOD 
The PAQ was administered to seven Naval surface warfare 
lieutenants. A PAQ question was considered relevant to this 
study if it fulfilled the following two criteria: 
(1) It received a mean score greater than or equal to four 
(of five). 
(2) It pertained to a mental skill, rather than a physical 


ability or an environmental factor. 
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CAR RESULTS 

Table 1 summarizes the results of the survey, listing 
the PAQ question number, average score, and related skill 
areas for those questions meeting the above criteria. The 
complete PAQ questions listed in Table 1 are presented in 


Appendix A. 


TABLE 1 
PAQ RESULTS 


Question Mn Score Skill Areas 


5 4.71 Use of visual displays 

11 4. 14 Observational ability (objects) 
TS 4.86 Observational ability (events) 
5 4. 14 Use of verbal information 
29 4.29 Ability to estimate speed 
36 4.57 Decision making skills 
37 4.14 Reasoning ability 
39 4,43 Integration of information 
40 4.29 Analysis of information 
45 4.29 Short term memory 
104 4. 29 Information exchange (routine) 
205 4. 43 Information exchange (non-routine) 
175 4.14 Attention to detail 
176 4.14 Recognition skills 
07 4.71 Vigilance (infrequent events) 
178 4. 71 Vigilance (changing environment) 
180 4.43 Ability to update memory 


۰۰ 71 
Skill areas used by the OOD on watch have been identi- 
fied by use of the PAQ. It is these abilities which deter- 


mine the performance of the  OOD. If these skills are 


17 


adversely affected by the environment, the result could be 
an overall decrease in the officer's ability to make correct 
decisions based on the soundness of his judgement. The next 
step is to determine how performance in these areas can be 


assessed under varying conditions. 


IKS 


ive AUTOMATED PORTABLE TEST SYSTEM 


A. BACKGROUND 

Ihe Automated Portable Test System (APTS), and its pred- 
ecessor, Performance Evaluation Tests for Environmental 
Research (PETER), were designed to replace pencil and paper 
testing in environments where the more cumbersome tradi- 
tional tests were impractical or inconvenient (Merkle and 
others, 1985).  APTS uses a variety of software programs on 
small portable computers to test a number of skill areas. 

Developed by the Naval Aerospace Medical Research 
Laboratory Detachment, New Orleans, Louisiana, and by Essex 
Corporation, Orlando, Florida, these tests are most effec- 
tive when used to judge the effects of different environ- 
mental conditions on individuals (Kennedy and others, 1985). 
At present, their use in population comparison under stan- 
dard conditions is limited due to the lack of population 
data available. However, a high correlation between APTS 
Scores and those of their paper and pencil counterparts has 
been shown to exist (National Science Foundation, 1985). An 
added advantage of the APTS is that the real-time nature of 
the tests allows the study of some skills which do not lend 
themselves to the static format, such as the identification 
and tracking of a moving target. 

The primary requirements for an APTS test are consis- 
tency for a given subject over multiple trials in a constant 
environment, sensitivity in distinguishing between individ- 
uals, and investigation of some meaningful aspect of human 
performance (Bittner and others, 1984, 1985). Ideally, a 
test will have a steep initial learning curve which flattens 
out to a relatively constant level after a small number of 
repetitions (Kennedy and others, 1980; Essex Corporation, 
SS)" 
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Software for a wide variety of physiological, psycholog- 
ical, and mental ability tests is currently available or is 
under development. Areas that tests are available for 
include: short term memory, visual acuity, mathematical 
ability; integration between brain hemispheres, spatial 


orientation, and reaction time (Essex Corporation, no date). 


B. CORRELATION OE APTS UTE 

APTS test descriptions were matched with PAQ questions 
to choose the appropriate tests. In the majority of cases 
the choice was clear-cut, although not all of the most 
appropriate tests could be used. The APTS tests used in this 
study were dictated not only by the relevant skill areas, 
but also by the tests' availability. Not every test in use 
is available for use at the Naval Postgraduate School. 

Ihe skill areas assessed by the tests used in this study 
are recognition skills (questions 5,11,13,176), short term 
memory (questions 45,180), reasoning ability (question 37), 
as well as encoding ability and dynamic visual acuity. Tests 


for such skills as vigilance, decision making, and ability 


to communicate were not available. A summary of PAQ ques- 
tions, skill areas, and matching APTS tests is presented in 
Table Z 


C. DESCR OE ھ۹۹‎ 
The following is a brief description of the five APTS 


tests used for this experiment, as described by Essex 
Corporation documentation (no date). All tests are adminis- 
tered on a timed basis, with new problems presented as soon 


as the previous one has been responded to, correctly or not. 

Each test has a duration of one minute, and each repetition 

is preceded by a brief practice session. 

(1) PATRNC (pattern comparison) requires the observer to 
compare two concurrently presented abstract patterns, 


and to determine if they are the same or different. 
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IABLE 2 
DIATSHEDSEAROLOUESTIONSCAND APTS TESTS 


PAQ Question Skill Area APTS Test 
= ul displays ENO, 
اھ2‎ LS Observational abilities PATRNC 
15 Use of verbal information  ==-=== 
29 Ability to estimate speed ==-=== 
36 Decision making skills  ----- 
37 Reasoning ability REASON 
39, 40 Information processing | | |  ----- 
45 Short term memory CODSUB 
STERNB 
102105 Information exchange | | | |  ----- 
175 Attention to detail  ----- 
176 Recognition skills PATRNC 
TNS Vigilance | | | | eee 
180 Ability to update memory STERNB 


Response is made by pressing an "S" or a "D" on the 
keyboard, as appropriate. Performance on this test is a 
measure of visual search and target acquisition 
abilities. 

CODSUB (code substitution) displays the numerals 1-9 
beneath randomly selected letters of the alphabet. The 
observer refers to this "code" to assign the correct 
number to each of a series of letters appearing on the 
display below the code. This test measures encoding 
ability and short term memory, and is also considered a 
test of general intelligence. 

REASON (grammatical reasoning) presents a simple 
sentence describing the order of the letters A and B 


which appear after the sentence. Ihe observer must 
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(2) 


(3) 


decide whether the statement is true or false, and 
enter 2m or "EF" accordin iy: (example "A is not 
followed by B (BA)" is true). This test measures 
reasoning ability. | 

STERNB (Sternberg's short term memory scanning test) 
displays a set of four different digits for one second. 
Subsequently, a series of single digits is presented, 
and for each the observer must decide if it was in the 
set ("T"), or not ("E"). This is a ۹4٥٠٠٦٠ ٦٣ 
memory. 

LANDC (flying Landolt "C") displays a squared "C" shape 
moving from left to right across the display at varying 
speeds. The opening on the "C" may point up, down, left, 
or right. The observer indicates the correct direction 
by depressing one of four directional arrows on the 
keyboard. This test is still experimental, but is 
believed to assess dynamic visual acuity. Scores are 
calculated in centimeters per second, representing the 
average speed at which the observer first correctly 
identifies the "c". 


^ 


( 4) 


(>) 


V. EXPERIMENTAL METHOD 


Å. PURPOSE AND HYPOTHESIS 

As discussed in Chapter II, there has been little 
research on the effects of motion on human performance, 
aside from motion sickness studies. This experiment investi- 
gates some effects of such motion, with the intent of deter- 
mining if there is an effect on the mental performance of 
the OOD. 

Although it is possible that the effects of motion are 
negative, it is also possible that the effects could be 
positive, as motion could cause mild stimulation to a higher 
performance capability, as per the  Yerkes-Dodson Law 
(Hockey, 1979, p. 143). Thus, the null hypothesis is that 
there is no difference in performance on the tests between 
moving and non-moving subjects, against the alternate 
hypothesis that there is a difference, in either direction. 

The effect on performance due to learning is also exam- 
ined, as is correlation of test performance under conditions 
of both motion and non-motion with such factors as intelli- 
gence (SAT. scores), sea duty experience, and time since 


commissioning. 


Pas DHEOEXPERIMENT 
l. Participants 
The experimental participants were 15 male U.S. Navy 
surface warfare qualified Lieutenants and Lieutenant 
Commanders. They volunteered, and were not paid for their 
services. 
2. Experimental Apparatus 
a. Motion Simulator 
The ship motion simulator used for this study 


was constructed by students and staff at the Naval 
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Postgraduate School, and is pictured in Figure eee PEE 
apparatus consists of a platform, which is fitted with a 
chair and the microcomputer. The platform is rocked angu- 
larly from side to side by an axle attached to a rotary 
wheel, which is driven by a 3/4 HP General Electric motor. 

For this experiment, the platform was set to 
rotate laterally 12 degrees to either side of the hori- 
zontal, for a total arc of 24 degrees. The oscillation 
frequency was set at 0.06 Hz., or about 3 1/2 cycles per 
minute. The gentle movement was not enough to make any of 
the subjects motion sick, and was considered ean ace 
Simulation for this study. 

Participants were seated on the apparatus for 
all portions of the test, both moving and non-moving. 
Because it was not possible to isolate the equipment ina 
sound-proof environment, observers wore sound mufflers 
(mouse ears) throughout the testing to minimize the effects 
of ambient noise. 

b. Testing Apparatus 

The microcomputer used for this experiment is an 
NEC PC-8Z201A with a demonstration APTS package furnished by 
Essex Corporation. It is not equipped with memory capa- 
pille. and all scores must be recorded manually. 

The microcomputer provides instructions and 
examples for each test. These instructions are supplemented 
by the experimenter, who answers any questions the partici- 
pants may have prior to beginning the test. Following the 
test, the scores are recorded, and the participant 


instructed to continue to the next scheduled test. 
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32 Experimental Design 
The 15 observers were divided randomly into three 


groups: one control group and two experimental groups. 1ھ‎ 
three groups repeated each of the five tests a total of six 
times, in three batteries of two sets each. The experimental 


design is summarized in Table 3 


TABLE 3 
EXPERIMENTAL DESIGN 


Group Participant Numbers 了 Trial ا‎ 
Control I, 3. 19551511! 3 E 
EX E 2, 4,17, LODI : M 

Ex O 5. 608 SJ: : 3 M 


note: "M" denotes trial in which ship motion, is 
simulated, ”. denotes non-moving trial. 


All three groups completed the first battery while 
not MOVING The primary purpose of this was to allow prac- 
tice on the tests. The control group repeated the following 
two batteries in the same manner. The first experimental 
group (Ex B) performed the second battery while moving, and 
the third while stationary. The second experimental group 
(Ex C) reversed the order, and performed the second battery 


while stationary, and the third while moving. 


C. DATA ANALYSIS PROCEDURES 

For four of the tests, Pattern Comparison, Sternberg, 
Reasoning, and Code Substitution, Scores are treated sepa- 
rately as two dependent variables; error rate, and total 
response rate. The error rate is the proportion of the time 
that an erroneous response is entered (or the percentage of 
the time, for graphical purposes). The total response rate 
represents the total number of times a response is entered, 


correct or not. "Bor. the Landolt "C testi the 7 
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measurement variable is average speed at which the target is 
0تت‎ ٣٣٣٢٢۳۹٢ identified, recorded in centimeters per second. 
Each participant's results for each battery of two one- 
minute tests are summed for each test type. The Landolt 
speeds are averaged. This raw data is presented in Appendix 
B. 

Å two-way repeated measures analysis of variance is used 
to compare the results of the second and third batteries for 
the two experimental groups. The purpose of this analysis is 
to explore the effects of motion versus non-motion, as well 
as any difference between the two groups due to the order in 
which motion and non-motion are experienced, taking into 
account the differences between individuals. The hypotheses 
for these tests are: 

Ho: There is no difference in performance between the 
two groups based on either variable being studied (motion or 
order) 

H1: There is a difference in performance between the two 
populations based on one of these variables. 

Ihe format for the ANOVA is presented in Table 4. 


TABLE 4 
ANOVA- MOTION AND ORDER EFFECTS 


Source of Variation Degrees Freedom 


Between Subjects np-1=9 
order 1= 
Residual p(n- 
Within cub ects np( 
Motion 
Meeraetion (Pill 
Residual p(n-1 


The F ratio is compared with the F distribution with 
degrees of freedom egual to 1 and 8. The ANOVA is performed 


on both error and total response rates. 


Zi 


The analysis of variance for the average speeds of the 
Landolt "Cc" test is slightly modified due to unequal numbers 
of observations. One participant in experimental group "B" 
failed to perform this test adequately enough to register 
any SCOré, and so was dropped from the results for this 
test. The ANOVA method used is the unweighted means method, 
from Winer (1962, p. 377). The single measurement variable 
for performance on this test is the average speed at which 
the "C" is first correctly identified. 

In order to determine if learning from previous practice 
has a significant effect on performance between the second 
and third trials, a one way within-subjects ANOVA is 
conducted for both error rate and total responses for each 
of the tests but Landolt, for which average speed is again 
the criterion used. The results from all 15 participants are 


used for this ANOVA. The procedure is presented in Table 5 


TABLE 5 
ANOVA- LEARNING EFFECTS 


Source of Variation Degrees Freedom 
Between Subjects n-1=14 
Within Subjects n(k-1)=15 
Trial number k-1-1 
Residual (n-1)(k-1)=14 
ota N-1= 
Following these analyses, Pearson product moment corre- 


lations between each of nine variables are determined. 
Relationships are investigated between performance on each 
of the five APTS tests (measured as total number correct 
scored over the three batteries), and with four other vari- 
ables of background information: months of sea duty experi- 
ence, time since commissioning, and scores on the verbal and 
math portions of the Scholastic Aptitude Test (SAT), a test 
of general intelligence taken when the participants were in 
high sehooue The correlation analysis is performed on 12 


subjects for whom complete data were available. 
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VI. RESULIS 


A. PATTERN COMPARISON TEST 

Figure 6.1 displays a graphical representation of 
percent errors and average total responses for this test. 
KT TNS PIO ۲713۳" 00 وط0‎ versus performance for each of 
the three groups. The figure indicates a higher error rate 
ge Derimental group B during trial 2, in which that group 
experienced simulated ship motion. Experimental group C and 
the control group display a decrease in error on the second 
trial, and an increase on the third. Hence, both experi- 
mental groups B and C experience higher error rates while in 
motion. The findings of Figure 6.1 are substantiated by 
those of Table 6, which finds the motion effect significant 
at the 0.10 level, also indicating higher motion error 
rates. Table 6 also indicates that the interaction between 
the two effects for total responses is significant at the 
Dol level. 


A significant learning effect for total responses is 
shown in Table 7 . The average total response plot of Figure 
6.1 also indicates improved overall performance over these 
erıals. It appears that one practice battery, consisting of 
two one-minute tests, was not sufficient to eliminate the 


learning effect for this test. 
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Pattern Comparison Test Results. 


Figure 6.1 


SIMVISIN IN3J43d 


YIBNAN Til 
06 





SJMVISIN 083 


ہج۔ وہر ۵0ا0 تہ 3 


8 dNOYN X3 --E--- 
IONOJ —t— 





Qi og 


OL 


02 
S3SNOdS3M TVLOL 


0318110101 YIL 
Oz 





S.JSNOdS34 TVIOL 7۷ 


TABLE 6 
PATTERN COMPARISON MOTION AND ORDER EFFECTS 
(EX B AND EX C) 
PERCENT ERRORS 
Source of Variation DF SS | MS F 


6606 7 u Paes . 2 


Order effect Il 3. 90E-4 3. 90E-4 0:58 
Residual 8 5. 36E-3 6. 7OE-4 
Within Subjects TO 24191 = 3 
Motion effect i 4.70E-4 4. 7OE-4 1. 20 
Interaction 1 1. 40E-4 1. 40E-4 0236 
Residual 8 3. 14E-3 3.93E-4 
ota 
TOTAL RESPONSES 
Source of Variation DF SS MS F 
etween Subjects : 
Group Effect 1 296. 45 296. 45 0.84 
Residual 8 2822.00 952.15 
Within Subjects 10 216. = 
Motion effect il 26. 45 26.45 4.27 
Interaction l 140. 45 140. 45 22 66 
Residual 8 49. 6 6.2 
ota 
TABLE 7 
PATTERN COMPARISON LEARNING EFFECT 
(ALL GROUPS) 
PERCENT ERRORS 
Source of Variation DF Ss MS F 
Between Groups 14 l.22E-2 
Within Groups 15 4. 63E-3 
Bearningszeffectz 1 1. 00E-5 1. 00E-5 0:08 
Residua 14 4. 62E-3 3. 30E-4 
Total 29 
TOTAL RESPONSES 
Source of Variation DF SS MS E 
Between Groups 14 6015.87 
Within Groups 145 250. 00 
ed effect 1 112. 14 112. 14 11. 39 
Residua 14 Eo E6 9.85 


Total 29 


Sul 


B. CODE 617 

Although Figure 6.2 indicates that experimental groups 
"B" and "C" again display higher error rates for the motion- 
related trial, the ANOVA in Table 8 indicates significance 
only at the 0.25 level. The total response section of this 
table also attributes a 0.10 significance to the interaction 
of group affiliation and motion. Table 9 finds the learning 
effect for this measure significant at the O.10 level. 

The average total response graph of Figure 6.2 reflects 
overall group differences between the three groups, and 
Table 8 indicates a significant order effect difference of 


0.10 between experimental groups B and C. 


C. REASONING TEST 

For this test, Figure 6.3 again shows experimental 
groups B and C having unusual error rates for the trial 
associated with motion. In this case, however, the error 
rate tends to be smaller when motion is occurring. Table 10 
finds these results significant at the 0.10 level. A O.10 
significant interaction effect is again noted between the 
group and motion variables for total responses. There is 
also a 0.10 significant learning effect for this measure 
indicated by Table 11 


D. STERNBERG] Teo. 

Figure 6.4 indicates that again both experimental groups 
B and C exhibit decreased error rates for the trial associ- 
ated with motion. However, Table 12 attributes no signifi- 
cance to this observation. Figure 6.4 also indicates an 
overall upward trend with trial number in average total 
responses for all three groups. The ANOVA of Table 13 
finds this significant at the 0.10 level, indicating that a 
learning effect is quite probable between the second and 
third trials for the three groups. No interaction effects 


are noted in Table 12 


Ss 
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Code Substitution Test Results. 
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TABLE 8 


CODE SUBSTITUTION MOTION AND ORDER EFFECTS 
(EX B AND EX C) 


PERCENT ERRORS 
Source of Variation DF SS | MS F 


Between Subjects 9 3.88E-3 
Order effect 98 1 
Residual 
Within Subjects 
MOE OHM E ESC 
1 6 6 ٦ 
Residual 


Total 19 
TOTAL RESPONSES 
Source of Variation DF SS MS E 


Between Subjects 9 2404.45 
Group effect 1 | 09. 39 
ae 28 


lO 
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CODE SUBSTITUTION LEARNING EFFECT 
(ALL GROUPS) 


PERCENT ERRORS 
Source of Variation DF SS MS F 


Between Groups 14 7. 20E-3 

within ۹ 15 2. SSE S 
Learning effect _1 OM Sk 
RESTENE 14 2 7 6E ih 


Total 29 
TOTAL RESPONSES 
Source of Variation DF SS MS F 


Between Croups 14 3650.47 

Wem ODE 15 18 
Learning effect l S 34.14 3109 
Residua 14 15 11406 


Total 29 
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Reasoning Test Results. 


Figure 6.3 
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TABLE 10 
REASONING MOTION BN ORDER EFFECTS 
(EX B AND EX C) 
ERROR RATES 
Source of Variation DF SS ۱ MS F 


etween Subjects 。 一 


Order effect 1 9. 50E-3 9. 5OE-3 4. 72 
Residual 8 1.61E-2 2.01E-3 
۷۷1 ذ3ط‎ 17" 510۳7۰6 ٤ 10 1.49E-2 
Motion effect 1 4. 32E-3 4. 32E-3 s 5l 
Interaction 1 7.50E-4 7.50E-4 (61 
Residual 8 9.84E-3 1. 23E-3 
ota 
TOTAL RESPONSES 
Source of Variation DE SS MS F 
Between Subjects 2 
Group effect l 2.45 2.45 002 
Residual 8 1132.80 141.60 
Within Subjects 10 52.50 
Motion effect 1 4.05 4.05 1. 07 
Interaction 1 18.05 18.05 475 
Residual 8 30. 40 3.80 
ota 
TABLE 11 
REASONING LEARNING EFFECT 
(ALL GROUPS) 
PERCENT ERRORS 
Source of Variation DF SS MS F 
Between Groups 14 4. l19E-2 
Within Groups 15 4. 59E-2 
Learning effect 1 1. OOE-4 1. 00E-4 0. 03 
Residua 14 4. 58E-2 3.Z7E23 
ota 
TOTAL RESPONSES 
Source of Variation DF SS MS E 
Between Groups TA 1416.20 
Within Groups 15 64. 50 
Learning effect 1 12203 12.03 32 
Residua 14 5 84 / SR 
Total Z9 
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31+1 


Sternberg Test Results. 


Figure 6.4 
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TABLE 12 
STERNBERG MOTION AND ORDER EFFECTS 
(EX B AND EX C) 
ERROR RATES 
Source of Variation DE SS MS E 


etween u CGS . = 


Order effect i 1. 04E-3 1. 04E-3 15 1 
Residual 8 5. 49E-3 6. 86E-4 
Within subjects 10. SES 
Motion effect il 2. /4E-4 2. 74E-4 031 
Interaction 1 3. 60E-5 3608655 6 0 
Residual 8 3. OLE-3 3. 76E-4 
Total 19 
TOTAL RESPONSES 
Source of Variation DF SS MS 3 
etween Subjects ۱ 
Group effect 1 0.00 0. 00 0. 00 
Residual 8 1453.80 TISI 72 
Within Subjects 10 45. 00 
Motion effect 1 3. 20 3.20 0266 
Interaction 1 3. 20 SA 0.66 
Residual 8 38.60 4.83 
Toral I9 
TABLE 13 
STERNBERG LEARNING EFFECT 
(ALL GROUPS) 
PERCENT ERRORS 
Source of Variation DF SS MS F 
Between Groups 14  1.12E-Z2 
Within Groups 1:5 6. 10E-3 
Learning effect 1 6. OOE-4 6. OOE-4 1.99 
Residua 14 5. 50E-3 3. 93E-4 
ota 
TOTAL RESPONSES 
Source of Variation DF SS MS E 
Between Groups 14 2227.00 
Within Groups 15 56-0 
Learning effect J 117:63 1768 3568 
Residua 14 68. 87 4.92 
ota 
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E. LANDOLT TEST 

The average speed measure for this test indicates a 
sharp increase in performance from the first to the second 
trial, as indicated in Figure 6.5 . This overall increase is 
not carried past the second trial, however, and little 
difference is noted between the second and third trials. 
Table 15 bears out this finding by indicating no significant 
learning effect between these trials. 

Table 14 finds no significant differences in either 
measure of performance between the two experimental groups 
due to motion or order effects. This agrees with data repre- 


sentation in Figure 6.5 


F. CORRELATION ANALYSIS 

Ihe Pearson product moment correlations among perform- 
ance on the five tests and the four items of background data 
are summarized in Table 16 . The background data items are: 
verbal (VER) and math (MAT) SAT scores, sea duty experience 
(SDE), and time since commissioning (TSC). 

The correlations among the five APTS tests are, in 
general, significantly positive (greater than 0.5). The only 
exceptions to this are the Code Substitution and Sternberg 
tests, which have smaller but still positive correlations 
with the Landolt test. The only other significantly high 
correlation of any importance is between performance on the 


Pattern Recognition test and math SAT scores. 
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Landolt Test Results. 
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TABLE 14 


LANDOLT C MOTION AND ORDER EFFECTS 
(EX B AND EX C) 


AVERAGE SPEED 
Semrce of Variation DF SS | MS F 


Between Subjects 8 
Order effect l 
~ Residual I 
Within Subjects 
Motion effect al 
Interaction l 
Residual 8 


Total 17 


TABLE 15 


LANDOLT C LEARNING EFFECT 
(ALL GROUPS) 


AVERAGE SPEED 


Source of Variation DE SS MS F 
Between Groups 13 119240. 47 
Within Groups 14 ROS] 3. 25 
Learnind effect 1 171. 76 6 0.14 
Residua VS 16341.49 1257.04 
ota 
TABLE 16 


CORRELATION BETWEEN APTS TESTS AND BACKGROUND DATA 


BEI REAT COD STE LAN VER MAT SDE TSC 


PATRNC (9 52 67 74 59 05 SI e222 =. 20 
REASON 1.00 64 70 60 Seem. oO =. 02 400 
CODSUB 68 36 =. 18 -.060w€-.26 =. 10 
STERNB 00 25 027.23 -.24 -. YU 
LANDC 1:00 ESE OG .14 , . 00 
V. SAT i Ose: Ose .14 000 
M. SAT 1 000=.. 125. 00 
SDE 1. 900. 0 
uc 1: O0 
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The five objectives outlined in Chapter I have been 
addressed by this project. The following is a summary and 
discussion of these findings. 

Results from the PAQ identified a number of cognitive 
skills crucial to the OOD's performance. These are: visual 
recognition and observational abilities; information anal- 
ysis, processing, and storage capabilities; reasoning and 
ability to make decisions; short term memory; ability to 
communicate effectively; speed estimation; and vigilance and 
attention to detail. 

Not all of these skills lend themselves to standardized 
testing, and not all that are so suited actually have a test 
available for them. Such critical characteristics as Midis 
lance and ability to make decisions could not be addressed 
by this study. The following skills were studied: visual 
skills, reasoning, short term memory, recognition, and 
ability to update memory. 

Ihose tests administered to examine motion effects on 
these skills yielded mixed results. A 0.10 significant 
negative effect due to motion was found for the Pattern 
Comparison and Reasoning tests' total response rate. Motion 
caused a slight increase in the Code Substitution error 
rate. In addition, graphical plots of error rate versus 
trial number give some indication that error rate is related 
to motion. Motion appears to increase error rate for the 
Pattern Comparison and Code Substitution tests, but to 
decrease error rates on the Reasoning and Sternberg tests. 

This varying effect on error rates may be explained by 
the Yerkes-Dodson law (Hockey, 1979, p. 2143). The arousal 
level caused by the ship motion simulator may be close to 


optimal for some tests, but too high for others, causing a 
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negative impact. Ihe Pattern Comparison and Code 
Substitution tests both require relatively rapid and auto- 
matic responses, while the Reasoning test requires longer 
consideration, and the Sternberg test requires concentration 
to retain facts in memory. It is possible that the Reasoning 
and Sternberg tests, which rely more heavily on the ability 
to concentrate, are benefited by mild arousal. Perfomance 
on the Pattern Recognition and Code Substitution tests, 
which rely on rapid, almost reflexive action, may suffer 
Prom the stimulation. 

The purpose of correlating performance on these tests 
with background data is to pave the way for prediction 
models to be used in the selection and qualification of 
Surface Warfare officers. However, the only significant 
correlation noted was between Pattern Recognition ability 
and score on the math SAT. No other significant correlations 
were found. 

The APTS proved to be ideally suited to this type of 
study. The tests are easily administered, and little phys- 
ical activity is required which could be affected by motion. 
Unfortunately, the two practice tests of one minute each did 
not generally prove to be sufficient to stabilize individual 
performance levels. For the Pattern Comparison, Reasoning, 
Code Substitution, and Sternberg tests, significant learning 
effects were noted between the second battery (third and 
fourth tests), and the third battery (fifth and sixth 
tests). In future studies, more practice sessions would be 
advisable for these tests. 

The Landolt test proved to be the one weak point of the 
APTS. The test format was unsettling to observers, who often 
believed that the display was malfunctioning. In addition to 
this, the performance of a single participant varied so 
widely from one session to another that any underlying 
motion, group, or learning effects were effectively lost in 


the noise. 
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The very skills that an OOD may need to call upon under 
stressful conditions may themselves be affected by those 
conditions. An important Criterion for the quakificat ion mi 
those officers who will be placed in positions of responsi- 
bility should be that their performance under conditions 
such as extreme ship motion is adequate to the task. 
Increased error rate may have more far reaching consequences 
than depressed response rate, and safeguards to prevent 


Simple errors from becoming major disasters are crucial. 
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APPENDIX A 
SELECTED QUESTIONS FROM THE POSITION ANALYSIS QUESTIONNAIRE 


Ihe following PAQ questions used for this study are 


up ııtederrom Harris and McCormick (no date). 


I) Rate each of the following items in terms of how much it 
is used by the worker as a source of information in 
performing his billet. 

5) Visual displays (dials, gauges, signal lights, radar 
scopes, speedometers, clocks, graphic displays, etc. ) 

11) Man-made features of environment (structures, ships, 
buildings, dams, highways, bridges, docks, and other "man- 
made" or altered aspects of the indoor or outdoor environ- 
ment which are observed or inspected to provide job 
information. ) 

13) Events or circumstances (those events the worker 
visually observes and in which he may participate, such as 
movements of ships, movement of materials, airport control 


tower operations, etc.) 


15) Verbal sources (verbal instructions, orders, 
requests, conversations, interviews, discussions, formal 
meetings, etc.; consider only verbal communication which is 


relevant to job performance. ) 


II) In this section are various operations involving estima- 
tion or judging activities. In each case consider activities 
in which the worker may use any or all of the senses; for 
example, sicht, hearing, touch, etc. Continue using the 


"Importance to Billet" scale. 
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29) Estimating speed of moving objects (estimating the 
speed of moving objects or materials relative to a fixed 
point or to other moving objects; for example, the speed of 


vessels or aircraft, materials on a conveyor belt, etc.) 


III) Decision making, Reasoning, and Planning/Scheduling 
36) Decision making (indicate, using the code below, the 

level of decision making typically involved in the billet, 
considering: the number and complexity of the factors that 
are taken into account; the variety of alternatives avail- 
able; the consequences and importance of the decisions; the 
background experience, education, and training required; the 
precedents available for guidance; and other relevant 
considerations. The examples given for the following codes 
are only suggestive.) 

(1) Low ("decisions" such as those in selecting parts in 
routine cleaning, shelving items in a storeroom, etc.) 

(2) Below Average ( "decisions" such as those in operating or 
dispatching vehicles, lubricating a truck, etc.) 

(3) Average ("decisions" such as those in setting-up machine 
tools for operation, diagnosing mechanical disorders of 
aircraft, ordering office supplies several months in 
advance, etc.) 

(4) Above Average ("decisions" such as those in making 
personnel decisions such as promotions and disciplinary 
actions, determining flight plan, etc.) 

(5) High ("decisions" such as those in recommending major 


surgery, determining battle strategy, etc.) 


37) Reasoning in problem solving (indicate, using the 
code below, the level of reasoning that is required of the 
worker in applying his knowledge, experience, and judgement 
to problems.) 
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(1) Low (use of common sense to carry out simple, or rela- 
tively uninvolved instructions; for example, sweeper, 
messenger, stores working party, etc.) 

(2) Below Average (use of some training and/or experience to 
select from a limited number of solutions the most 
appropriate action or procedure in performing the 
billet; for example issuing clerk, mess stewards, etc.) 

(3) Average (use of relevant principles to solve practical 
problems and to deal with a variety of concrete vari- 
ables in situations where only limited standardization 
exists; for example, draftsman, carpenter, ship naviga- 
tion, non-routine repair of mechanical equipment, etc.) 

(4) Above Average (use of logic or scientific thinking to 
define problems, collect information, establish facts, 
and draw valid conclusions; for example, individual with 
major responsibilities for diagnosis and repair of 
complex electronic and weapon systems, aeronautical 
engineering officer, etc.) 

(5) High Use Of principles 68۶۰۲۹٦٦3٣١ or scientific 
thinking to solve a wide range of intellectual and prac- 
tical problems; for example, commanding a vessel, 


research scientists, etc.) 


IV) In this section are various human operations involving 
the "processing" of information or data. Rate each of the 
following items in terms of how important the activity is to 
the completion of the job. 

senn ING information (Vceombinind, synthesizing, or 
integrating information or data from two or more sources to 
establish new facts, hypotheses, theories, or a more 
complete body of related information; for example,  inte- 
grating intelligence information, a pilot flying an 
aircraft, a weatherman using information from various 
sources to predict weather conditions, radarman, signalman, 
etc.) 
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40) Analyzing information or data (for the purpose of 
identifying underlying principles or facts by breaking down 
information into component parts; for example, interpreting 
intelligence reports, diagnosing mechanical disorders or 
medical symptoms, ECM operators, etc.) 

45) Short-term memory (learning and retaining job- 
related information and recalling that information after a 
brief period of time; for example, cook, telephone operator, 


helmsman, messenger, etc. ) 


V) This section deals with different aspects of interaction 
between people involved in various kinds of work. 


104) Routine information exchange (the giving and/or 


receiving of information of a routine or simple nature; for 
example, radio operator, receptionist, information clerk, 
ete) 


105) Non-routine information exchange (the giving and/or 
receiving of information of a non-routine or complex nature; 
for example, engineers discussing shipyard overhaul,  offi- 
cers" call, CIC ES OOD, okt KN ete 


VI) This section lists various types of demands that the job 
situation may impose upon the worker, usually requiring that 
he adapt to these in order to perform his work satisfacto- 
rily. Rate the following items in terms of how important 
they are to the billet. 

175) Attention to detail (need to give careful attention 
to various details of one's work, being sure that nothing is 


left undone. ) 


176) Recognition (need to identify, recognize, or 
"perceive" certain objects, events, processes, behavior, 
etc., or aspects, features, or properties thereof; this item 


is primarily concerned with “recognition of that VINGE 


"sensed" by vision, hearing, touch, etc. ) 


48 


177) Vigilance: infreguent events (need to continually 
search for very infrequently occurring but relevant events 
pneenDesobosrtuation; for example, look-out watch, observing 
instrument panel to identify infrequent change from 
normal etc.) | 


178) Vigilance: continually changing events (need to be 


continually aware of variations in a @oncCinually “or 
Paequemmely changing situation; form example, driving in 
usismicconcrollunešārrcraft.traffie,, Continuallvy watching 


frequently changing dials and gauges, etc.) 

120) Updating job knowledge (need to keep knowledge 
current, being informed of new developments related to the 
bwLlet.) | 
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two one-minute 


Scores are 


APPENDIX B 


RAW DATA SCORES 


responses. 


represents the sum over 
The format for all tests but Landolt is as follows: 


number of Landolt 


Each data point 


trials 


number correct/ 


recorded as speeds in centimeters per second. 


STERNB  LANDC 


95 
90 
25 
95 
30 


60. 
TIO 
13% 
48. 
46. 
105 
285 
609 
280 
. 40 
20 
SD 
LS 
+20 
99 
395 


48/50 
47/50 
55/55 
42/45 
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58/58 
41/42 
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CODSUB 


50/50 
53/53 
54/54 
41/41 
41/42 
47/47 
44/46 
49/50 
55/55 
65/66 
69/71 
83/83 
44/50 
56/56 
55/55 
37/38 
41/42 
42/44 
42/42 
45/48 
43/44 


REASON 


1922 
22/07 
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16/19 
18/20 
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31/34 
27,732 
33/35 
31/34 
42/42 
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33/33 
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23/25 
200/25 
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